1 CLAIMS : 



2 Having thus described our invention, what we claim as 

3 new and desire to secure by Letters Patent is as 

4 follows: 

5 ^Ty/U A^Nmethod for restoring a geometrically distorted 

6 >y^copy of\a\ reference image, said method comprising: 

7%n automatically determining a type and amount of 
8 / distortionVf said distorted copy; and 

9/ substantially Veversing the distortion to form a 

ICp reoriented imagfe. 

11 2. A method a&VreVited in claim 1, further comprising 

12 horizontally and\ vertically aligning the reoriented 

13 image with the \rekerence image to form a realigned 

14 image. \ \ 

15 3. A method as rec\tAcKAn claim 2, further comprising 

16 e?ft:racting a watermark trom the realigned image. 

17 7r \r[ - AVethod as recited in claim 1, wherein the step of 

18 automatically determining includes: 

19 composing^ a geometric alteration of the distorted copy 

20 by making Vhe distorted copy the same size as the 

21 reference image; \ 
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defining a ^afe area having safe pixels, wherein said 
safe area isttan intersection of pixels in the reference 
image with pikels in the geometric alteration, and said 
safe pixels includes any pixel from the reference image 
or the geometr^p alteration which lies in the safe 
area; 

selecting 'n' po^ts in the safe area, wherein 'n' is 
at least three arid\not all 'n' points lie on a straight 
line; 

building a list of \'\n' reference centers, wherein each 
reference center cot^esponds to coordinates of a 
particular pixel lyinb closest to a particular one of 
said 'n' points; 

constituting a plural^y of pairs of sub -images, 
wherein each pair is centered at one of said reference 
centers and each pair i\fc formed by a sub- image from the 
geometric alteration anq a corresponding sub -image from 
the reference image; 



minimally horizontally anti\ vertically positioning from 
an original sub -image pos\t3^on to a new sub -image 
position any sub-image paifr paving any sub-image pixel 
lying outside the safe are4# \such that said any 
sub -image pixel lies within\ tl\e safe area; 



adjusting the reference center of\ said any sub -image 
pair to correspond to said new sub\image position; 



computing a 
from eaqh of 



two-dimensional cross correlation surface 
the 'n' pairs; 



locating \a horizontal, p n , and a vertical, q n , 
coordinate offiset of the greatest peak on each 
cross- correlation surface; 



calculating\a plurality of distorted centers; 



using the adj^tstled centers and the corresponding 
distorted centerls to compute the coefficients matrix, 
A, of a pixel position interpolation equation; and 



forming a sub -matrix, S A , from the first, second, 
fourth and fifth elements of the matrix A. 

5. A method as recited in claim 4, further comprising: 

computing a set of proposed reference centers based on 
the distorted reference centers and the pixel position 
interpolation equations; 



computing the Euclidean \distances between the proposed 
reference centers and the adjusted centers; 



testing each Euclidean distances to determine if said 
each Euclidean distance is Statistically improbable; 
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corresponding 
distance that 



# 



discarding sap_d each distorted center and its 

adjusted center that define a Euclidean 
is statistically improbable while 
retaining \at ikast three not-discarded distorted 
centers and thevLr corresponding adjusted centers; and 



6 recomputing \the coefficients matrix, A, of a pixel 

7 position interpolation equation using the at least 

8 three not -discarded distorted centers and corresponding 

9 adjusted centers. 



10 6. A method as recited in claim 4, wherein the steps 

11 of substantially reversing includes: 
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factoring the subvhatrix S A into four primitive image 
manipulation matrices; 



applying the four 
to the geometric a] 
image; 



primitive image manipulation matrices 
teration to produce a reoriented 



making the geometri 
reoriented image if 
matrix produces a dL 



z alteration identical to the 
any primitive image manipulation 
stortion greater than a 



predetermined threshold, said distortion determined by 



examining all iterat. 
changes in the Eucl] 



repeating all the s 
composing, all the s 



ion- to- iteration incremental 
dean distances; and 



A 



teps of claim 4 except the step of 
teps of claim 5, and the steps of 



DOCKET NUMBER; YO9991034 




factoring, applying and making until no primitive image 
manipulation matrix produces a distortion greater than 
the predetermined threshold. 



7. A nflethfod, as recited in claim 4, wherein the step 
of horizontally and vertically aligning includes 
translating horizontally the reoriented image by the 
value of^ the | third coefficient of the matrix, A, and 
translating vertically the reoriented image by the 
value of \the I sixth coefficient of the matrix, A, to 
form the realigned image. 

8. A method 4 s recited in claim 3, wherein the step of 
composing kncSudes: 



shrinking o\r enlarging the distorted copy vertically by 
pixel interpolation or extrapolation such that the 
produced geometlric alteration has a same height as the 
reference image!, and 



shrinking or enlarging the produced geometric 
alteration horizontally by pixel interpolation or 
extrapolation t$ have the same width as the reference 
image . 



9. A method as Jrecited in claim 4, wherein the 
coordinate offsejts^are non- integers and the step of 
locating includes using interpolation. 
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10 . A i^ethod, a 
referencje image 



3 recited in claim 1, wherein the 
s an original unmarked image. 



11. A method as recited in claim 4, wherein the step 
of computing includes: 



comparing \a region in the geometric alteration 
surrounding each of ^said reference centers with regions 



in the reference ima 
multiplicity of coordinate offsets; 



of each selected re 
horizontal and vert 
the geometric^ a 
reference image mos 



je shifted in position by a 



ascertaining horizontal and vertical coordinate offsets 

erence center as being the 
Leal offset at which the region in 
and the region on the 
nearly match; and 



Iteration 



calculating the\ dis :orted centers from the coordinate 
offsets and the corresponding reference centers. 



12 . A method as 
of comparing inc 



recited in claim 11, wherein the step 



luc es 



cros 



s correlation function in which 
of the cross correlation function 



using a modified 
the Fourier transform 1 

is computed, where .n magnitudes of the Fourier 
transform coeffici 
magnitudes uniform r 



nts are modified to make said 
and 
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usir^g an inverse Fourier transform to compute the 
modified cori/elation function. 



13. methodlas recited in claim 11, wherein the step 
of comparing includes: 

using a weighted cross correlation function in which 
the Fourier transform of the cross correlation function 

iin a weighted sum of the ordinary and 
transform coefficients is formed, and 



is competed, 
modified Fouri 



er 



whore 



using an inverse Fourier transform to compute the 
weighted! correlation function. 



14 . A method as 
of ascertaining 



composing a\ geon 
by making the di 
reference image 



defining a safe^ 
safe area is an 
image with pixe 
safe pixels inc 
or the geometri 
area; 

building a list 



recited in claim 8, wherein the step 
includes : 

etric alteration of the distorted copy 
storted copy the same size as the 



area having safe pixels, wherein said 
intersection of pixels in the reference 



V 1 



s^ in the geometric alteration, and said 
udes any pixel from the reference image 
alteration which lies in the safe 



of reference centers, wherein each 



reference centejr corresponds to coordinates of a 

22 
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1 particular pfxel in the safe area lying closest to a 

2 particular oi^e of said at least three pixel locations; 

3 computing a\p^irality of corresponding distorted 

4 centers; 
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using the referei 
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ice centers and the corresponding 
to compute coefficients of a matrix, 
A, of pixel positlion interpolation equations; 



distorted centers 



testing each di^ 
distorted center 



15 



An article o 



florted center to determine if said each 
is statistically improbable; and 

\ 

discarding each dp-^storted center that is statistically 
improbable while tetaining at least three not-discarded 
distorted centers \intil no more distorted centers are 
discarded. 



manufacture comprising a computer 
usable medium havj ng computer readable program code 
means embodied therein ttor causing a restoring of a 
geometrically dist orted\copy of a reference image, the 



computer readable 
manufacture compri 
means for causing 



program code means in said article of 
sing computer readable program code 
a computer to effect: 



automatically 
distortion of saic 



det€ rmining 



a\type and amount of 
distorted! copy; and 
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substantially reversing the distortion to form a 
reoriented image. 



16. An\ article of manufacture as recited in claim 15, 
the computer readable program code means in said 
article of manuMcture further comprising computer 
readable program\code means for causing a computer to 
effect horizontally and vertically aligning the 
Ai 



reoriented Umac 
realigned inlage 




17. An article c 
the computer r 
article of manufa 
readable program 
effect extracting 




8. An article o 
erein the 
unmarked image . 



the reference image to form a 



manufacture as recited in claim 16, 
adhble program code means in said 
^ture further comprising computer 
zode means for causing a computer to 
a watermark from the realigned image 



reference 



: manufacture as recited in claim 15, 
image is a copy of an original 



19. An article dfl manufacture as recited in claim 15, 
wherein the step ctf automatically determining includes 



selecting a set of 
the geometric al 



ter- 



t least three reference centers in 
tion; 



comparing a region 
surrounding each 




in\the geometric alteration 
said reference centers, with 



24 



DOCKET NUMBER; YO999-034 



# 



* 



1 

2 

3 
4 
5 
6 
7 

8 

9 

10 
11 



regions in th^ 
multiplicity 



reference image shifted in position by a 
coordinate offsets; 



ascertaining horizontal and vertical coordinate offsets 
of each selected reference centers as being the 
horizontal and vertical offset at which the region in 
the geometric alteration and the region on the 
reference image most nearly match; and 



determining the t; 
coordinate offsets 



e and amount of distortion from the 
and the set of reference centers. 



20. An article of manufacture as recited in claim 19, 
wherein the step of (comparing includes: 
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using a modified correlation function in which the 
Fourier transform of the correlation function is 
computed, wherein the 1 magnitudes of the Fourier 
transform coef f icientslWre modified to make said 
magnitudes uniform, ai 



17 using an inverse FouriAn transform to compute the 

18 modified correlation function. 
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21. An article of manufacture as recited in claim 19, 
wherein the step of ascertaining includes performing a 
least-squares fit on the! horizontal and vertical 
coordinate offsets of the se\ of reference centers. 
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22. A computer program product comprising a computer 
usable medium having computer readable program code 
means embodied therein for causing a readjusting of a 
geometrically distorted copy of a reference image, the 
computer readable program code means in said computer 
program prouuct comprising computer readable program 
code means for causing a computer to effect: 

automatically deternining a type and amount of 



distortion of said 



\ 



is tor ted copy; and 



substantially \reveqsing the distortion to form a 
reoriented image. 



SIS 
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23. An apparatus /for restoring a geometrically 
distorted copy of /a reference image, said method 
comprising: 



means for automatically determining a type and amount 
of distortion of / said distorted copy; and 



means for substantially reversing the distortion to 



form a reoriented image. 
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24. An apparatus as r y ecited in claim 23, further 
comprising hor/Lzorofta^y and vertically aligning the 
reoriented imqfge *d?|pi the reference image to form a 
realigned imade. 
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1 25. An apparatus as recited in claim 24, further 

2 comprising meajos' for extracting a watermark from the 

3 realigned imag^. 

4 W / # \ An a PP ar ^ us as recited in claim 23, wherein the 
Sy v^meansV for automatically determining includes: 

6 means for composing a geometric alteration of the 

7 distorted copy My making the distorted copy the same 

8 size as tthe reference image; 

9 means for defining a safe area having safe pixels, 

10 wherein said safe area is an intersection of pixels in 

11 the reference image with pixels in the geometric 

12 alteration, and said safe pixels includes any pixel 

13 from the reference image or the geometric alteration 

14 which lies in t^hi safe area; 

15 means for selecting 'n' points in the safe area, 

16 wherein 'n' is atlueast three and not all 'n' points 

17 lie on a straight! line; 

18 means for buildind a\list of 'n' reference centers, 

19 wherein each references, center corresponds to 

20 coordinates of a particular pixel lying closest to a 

21 particular one of Laid '\' points; 

22 means for constituting a plurality of pairs of 

23 sub -images, whereiri each pair\is centered at one of 

24 said reference centers and each pair is formed by a 
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sub -image from 
corresponding s 1 



geometric alteration and a 
►-image from the reference image; 




means for minimally horizontally and vertically 
positioning from original sub -image position to a 
new sub -image posi\titon any sub -image pair having any 
sub -image pixel lyindr outside the safe area, such that 
said any sub- image \pdLcel lies within the safe area; 



means for adjusting the reference center of said any 
sub -image pair to correspond to said new sub -image 
position; 



means for computing a 
surface from each of 

means for locating a 
q n , coordinate offset 
cross -correlation sur 

means for calculating 



two-dimensional cross correlation 
he 'n' pairs; 

lorizontal, p n , and a vertical, 
of the\greatest peak on each 
ace; 

a plurality of distorted centers; 



means for using the aqjusted centers and the 



corresponding distortetd centers 



coefficients matrix, A 
interpolation equation 



means for forming a sulp 
second, fourth and fi 



\ 



compute the 



, of a pixel\ position 
and 



-matrix, S A , from the first, 
elements of tke matrix A. 



ft:h 



v 
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27* An app4rat/us as recited in claim 26, further 
comprising: 



means for competing a set of proposed reference centers 
based on the distorted reference centers and the pixel 
position interpolation equations; 



means for computing 
proposed reference 



the Euclidean distances between the 
centers and the adjusted centers; 



means for testing! each Euclidean distances to determine 
if said each EuclpLdean distance is statistically 
improbable; 

\ 

means for discarding said each distorted center and its 

7 \ 

corresponding adjusted center that define a Euclidean 
distance that is statistical: 



\ 



.ly improbable while 



retaining at least three not -discarded distorted 

\ 

centers and their Corresponding adjusted centers; and 

means for recomputing the coefficients matrix, A, of a 
pixel position interpolation equation using the at 
least three not -discarded distqrted centers and 
corresponding adjusted centers. 



28, 



An apparatus as recited in cPaim 26, wherein the 



coordinate offsets are non-integers\ and the means for 

\ 

locating includes using interpolatio: 
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29. A method as recited in claim 1, wherein the steps 
of automatically determining and substantially 
reversing \aile repeatedly applied until an amount of the 
distortion\ falls below a given threshold. 



30. A method d& recited in claim 29, wherein the given 
threshold i^ le&s than a 0.5 pixel spacing. 

31. A method comprising: 

automatically measuring the degree of 
distortion imparted upon a distorted replica 
of an original image; 



substantially reversing the degree of 
distortion off the distorted replica to form 
an undi storied image; and 



aligning the Hindis tor ted image with the 

original imag< 

\ 

\, 

32. A method as recited in claim 31, further 
comprising determining whether the distorted replica 
image has been geometrically distorted relative to 



another form of the 



\ 

original image. 



manufacture comprising a computer 



\ 



33. An article of 

usable medium having computer readable program code 
means embodied therein fofy causing restoration of an 
image, the computer 



readable program code means in said 




31 

DOCKET NUMBER; YO999-034 



